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Abstract 

Let M. be a finite von Neumann algebra acting on a Hilbert space TL and 21 
be a transitive algebra containing Ai' ■ In this paper we prove that if 21 is 2— fold 
transitive, then 21 is strongly dense in B{TL). This implies that if a transitive algebra 
containing a standard finite von Neumann algebra (in the sense of is 2— fold 
transitive, then 21 is strongly dense in B(7i). Non-selfadjoint algebras related to free 
products of finite von Neumann algebras, e.g., LF n and (M 2 (C), ±Tr)*(M 2 (C), ±Tr), 
are studied. Brown measures of certain operators in (M 2 (C), \Tr) * (M 2 (C), \Tr) 
are explicitly computed. 

Keywords: transitive algebras, n— fold transitive, operator ranges, standard finite von 
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Introduction 



Let Ti be a complex Hilbert space and B(TL) be the set of bounded linear operators on 
7i. A subalgebra 21 of B(7i) is transitive if it contains the identity operator and has no 
invariant (closed) subspace other than the two trivial ones. The transitive algebra problem 
asks: if 21 is a transitive algebra on 7i, is 21 strongly dense in B{7i)l This problem was 
implicitly contained in a question of R. Kadison [18] concerning algebras whose invariant 
subspaces have invariant complementary subspaces, and it was W. Arveson [TJ who first 
explicitly stated the problem, coined the term "transitive algebra", and began an in-depth 
study of the problem. Note that an affirmative answer to the transitive algebra problem 
would give rise to an affirmative answer to (hyper) invariant subspace problem. The (hy- 
per) invariant subspace problem asks if an algebra generated by (the commutant of) a single 
bounded operator on 7i can be transitive. 



On the other hand, one's intuition expects that there exists a transitive algebra which 
is not strongly dense in B(TC). It is of interest, then, to know how one might strengthen 
the hypothesis so as to get a provable result. The first partial solutions of the transi- 
tive algebra problem were given by Arveson pQ. Arveson proved that if 21 is a transitive 
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algebra containing a MASA (maximal abelian von Neumann subalgebra) of B(TC), then 
the strong closure of 21 is 13(H) . For various generalizations of Arveson's results, we refer 
to HS1 HE] • Inspired by the invariant subspace problem affiliated with a von Neumann 
algebra, we consider the following construction: Let Ai be a von Neumann algebra acting 
on a Hilbert space and Ai' be the commutant of Ai. Suppose {T a } C Ai has no nontrivial 
common invariant subspace relative to Ai, i.e, if E e Ai satisfies ET a E = T a E for all T a 
then E = or /. It is easy to see that the algebra, 21, generated by {T a } and .M' is a 
transitive algebra. Now we may ask that if 21 is strongly dense in B(TC) when we choose 
Ai and {T a } suitably To make the question non-trivial, we first choose the "size" of Ai 
suitably large. 

Recall that a von Neumann algebra Ai acting on a Hilbert space TC is said to be standard 
if there exists a conjugate unitary operator J : TC — > TC, such that the mapping X — > JX*J 
is a * anti-isomorphism from Ai onto .M . Haagerup [TT] proved that every von Neumann 
algebra is *-isomorphic to a standard von Neumann algebra on a Hilbert space. If a von 
Neumann algebra Ai is standard on a Hilbert space TC, then At' is also standard on TC. 
We may ask the following question: If a von Neumann algebra Ai is standard on a Hilbert 
space 7i and 21 is a transitive algebra on TC which contains Ai', is 21 strongly dense in 
B(TC)1 By [21] (Theorem 8.26), if Ai is a type /oo factor, this question is equivalent to 
Kadison's transitive algebra question. So it is more interesting to restrict one's attention 
to the case where AI is a finite von Neumann algebra. Notably, if an abelian von Neumann 
algebra Ai is standard on a Hilbert space TC, then Ai is a MASA of B(TC). By [lj, any 
transitive algebra which contains Ai 1 = Ai is strongly dense in B(TC) and thus the answer 
to above question is affirmative. Suppose A"! is a finite von Neumann algebra acting on a 
Hilbert space TC and 21 is a transitive algebra which contains Ai'. In section 3 of this paper, 
we prove the following result: if 21 is 2-fold transitive (i.e., for any linearly independent 
vectors £, r\ in TC, the closure of {(T£, Trf) : T e 21} is Ti © TC), then 21 is strongly dense in 
B(TC). As a corollary, this implies that if Ai is a standard finite von Neumann algebra on 
a Hilbert space TC and 21 is a 2— fold transitive algebra containing Ai, then 21 is strongly 
dense in B(TC). This partly answers a question of Arveson [2j (also see 10.5 of [21]), which 
asks for a transitive algebra 21 whether 2— fold transitivity implies that the strong closure 
of 21 is B(TC). The proof of our result relies on a new characterization of n— fold transitivity 
and operator theory techniques. 

As applications, we study some non-self adjoint algebras related to (reduced) free prod- 
ucts of finite von Neumann algebras. In section 4, we prove the following result: Let(A4, r) 
be a finite von Neumann algebra with a faithful normal trace r. Suppose Af C Ai is a von 
Neumann subalgebra and Z e Ai satisfies the following conditions: 

1. Z ^ and r(Z) = 0; 

2. Z, Z((N" n M)QCI), ((Af' n M)QCI)Z are mutually orthogonal in L 2 (M, r). 
Let 21 C B(L 2 (M, r)) be the algebra generated by Z, Af and Ai' (relative to B(L 2 (M, r))). 
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Then 21 is a transitive algebra and strongly dense in B(L 2 (Ai, r)). As a corollary, we 
prove the following: Let (.Mi, 7~i), (A4 2 , ^2) be finite von Neumann algebras and jM = 
(A^i,ri) * (M 2 ,t 2 ) be the reduced free product von Neumann algebra and r be the in- 
duced faithful normal trace on M.. Suppose Af C A4i is a diffuse von Neumann subalgebra 
and Z G A4 2 is not a scalar. Let 21 C B(L 2 (A4, r)) be the algebra generated by Z, A/" and 
M . Then 21 is a transitive algebra and strongly dense in B(L 2 (Ai, r)). For example, let 
M. = LF n (2 < n < 00) be the type Hi factor associated with the left regular represen- 
tation A of the free group F n on n generators and a, b be two generators of F n . Let k be 
a positive integer and Z e {A(a)}" be a nonscalar operator. We show that the algebra 21 
on L 2 {M.,r) generated by Z,X(b) h , and M! is a transitive algebra and strongly dense in 
B(L 2 (Ai, r)). The proof of above results relies on techniques of type II± factors. Freeness 
also plays a key role. 

In section 5, we consider some interesting (but by no means trivial) non-self adjoint 
algebras relate to A4 = (M 2 (C), §TV) * (M 2 (C), \Tr) (reduced free product von Neumann 
algebra with respect to the normalized trace on M 2 (C)). Let (E i j) i . =l2 and (Fy ) t . =1 2 
be the matrix units in (M 2 (C), |Tr) * 1 and 1 * (M 2 (C), |TV), respectively. Consider the 
following subalgebras of B(L 2 (M., r)): 

1. 2li, the algebra generated by En, £ , 12 , -Fn and A4'; 

2. 2l 2 , the algebra generated by En, E12, F\ 2 and A4'; 

3. 2l 3 , the algebra generated by En, F 12 and M!\ 

4. 2t 4 , the algebra generated by E 12 , F\ 2 and A4'. 

In this paper, we prove that 2ti is a transitive algebra and strongly dense in B(L 2 (A4, r)). 
We then prove that 2I3 and 2U are not transitive algebras. Indeed, for any < r < 1, there 
are invariant subspaces E r and F r of 2I3 and 2I4, respectively, such that r(E r ) = r(F r ) = r. 
The main idea to prove that 2I3 and 2t4 are not transitive is as following. Note that 
2l 3 C {{En - E 22 + F 12 ) 2 }' and 2l 4 C {(E 12 + F 12 ) 2 }'. Based on the results of Brown 
measures of R— diagonal operators computed by Haagerup and Larson [13], we explicitly 
compute the Brown measures of En — E 22 + Fn and E\ 2 + F\ 2 by using techniques of free 
probability theory and operator theory. Then we apply Theorem 7.1 of [H] on the exis- 
tence of hyper invariant subspaces of operators which have non-single point Brown measure 
relative to factors of type The question that 2t 2 is transitive or not remains open! 

Remarkable progress on the (hyper)invariant subspace problem relative to a factor of 
type Hi have been made during past ten years (see for example [Hi El [121 El E2])- The 
fact that 2-fold transitivity of a transitive algebra containing a standard type Hi factor 
implies that the strong closure of the transitive algebra is B(TC) can be viewed as a support 
for the existence of nontrivial (hyper) invariant subspaces of operators relative to a factor 
of type Hi. 
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Besides the introduction, section 3, section 4 and section 5, there are two more sections 
in this paper. In section 1, we provide some characterizations of n— fold transitivity. To 
prove our main result (Theorem 3.1), some auxiliary lemmas are proved in section 2. 

For the general theory of operator theory and invariant subspaces, we refer to [21] . For 
the general theory of von Neumann algebras, we refer to [19]. For the general theory of 
free probability theory, we refer to [23J. 

We wish to thank professor Liming Ge for valuable suggestions that originally aroused 
our interest in the transitive algebra problem. We also thank professor William Arveson 
for valuable comments on the transitive algebra problem. 

1 On n— fold transitivity 

We begin this section by establishing some notation and terminology. Let 7i be a Hilbert 
space. A linear manifold in H is a subset of 7i which is closed under vector addition and 
under multiplication by complex numbers. A subspace of 7i is a linear manifold which is 
closed in the norm topology; the trivial subspaces are {0} and 7i. If P is a linear manifold 
in 7i, then [D] denotes the norm closure of T>. 

If T G B(H), the collection of all subspaces of H invariant under T is denoted by 
LatT; if 21 C B(H), then La£2l = HT^LatT. A subspace K is hyperinvariant for T if 
/C G Lat{T}', i.e., /C G LatS for every S commute with T. Let P G B(TL) be a projection, 
i.e., P = P* = P 2 . We say P G LatT if PH G LatT. P G LatT if and only if PTP = TP. 

If Ji is a Hilbert space and n is a positive integer, then Ti.^ denotes the direct sum of 
n copies of H, i.e., the Hilbert space H © • • • © H. If T is an operator on H, then 
denotes the direct sum of n copies of T (regarded as an operator on H.^). However, we 
will use /„ instead of I^ n > to denote the identity operator on Ti^. If 21 is a set of operators 
on H, then &( ft > = {T^ : T G 21}. We will identify B(H {n) ) with M n (C)®B(H) by writing 
T G B{H {n) ) as matrix form (7y)„xn- With this identification, 21^ = C/ n ©2l. 

Let 21 C B(7i) be a transitive algebra and n G N. Recall that 21 is said to be n—fold 
transitive if for any linearly independent vectors £i, £2, • • • , £n in H, [(S£\, • • • , S£ n ) : 
S G 21] = H {n) . Note that if 21 is n—fold transitive, then it is also m— fold transitive for 
each m < n. We consider n = 2, first. The following lemma is well known (cf. pQ). For 
the sake of completeness, we provide the proof. 

Lemma 1.1. Let 21 be a transitive algebra on a Hilbert spaceTi. For any £, 77 G 7i, £, 77 7^ 0, 
eztfier [(Tf , Tr?) : T G 21] = H {2) or there is a closed, densely defined operator S such that 
ST = TS for every T G 21 and G(S), the graph of S, equals to [(T^,Trj) : T G 21]. If 
G(S) = [(T£,Tr)) : T G 21], then S^ 1 (as a mapping) exists and Qi^S" 1 ) = [(Trj,T£) : T G 
21]. 
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Proof. We can assume that £,77 are linearly independent. Suppose Q = [(T£, T77) : T G 
21] ^ ^( 2 \ If there is z ^ such that (0, 2) G (?, then the closure of {(0,Tz) : T G 21} 
is © 7i since 21 is transitive. Thus © H C £ and £ = ft (2) . It is a contradiction. So 
(0, z) a Q implies that z = 0. Define ST£ = T77. Then S is well defined and G(S) = Q. So 
S is a closed, densely defined operator. By symmetry of £ and 77, S~ x Tr] = T£ is a closed, 
densely defined operator such that ^(S* -1 ) = [(Trj, T£) : T e 21]. □ 

In the following proposition we summarize some characterizations of 2— fold transitivity. 
"1 <^ 2" is proved by Arveson in pQ. The authors can not find the equivalence of 1,3,4 
in the literature (for example [1] and [21]). For the sake of completeness, we provide the 
proof. 

Proposition 1.2. Let 21 C B(TC) be a transitive algebra. Then the following conditions 
are equivalent: 

1. 21 is 2— fold transitive; 

2. If S is a closed, densely defined operator such that for any T G 21, TS = ST, i.e., 
for any £ G T>{S), TS^ = ST£ 7 then S = XI for some scalar A; 

3. For any £, 77 and £ G H, £ 7^ 0, i/iere exist a sequence T n in 21 S7ic/i i/iat T n £ converges 
to £ and sup n ||T n r/|| < 00/ 

4. Lat^=LatB(H) i2 \ i.e., for any projection P G M 2 (C]®B(H), if P G Lat(C/ 2 ® 21), 
t/ien P G M 2 (C) ©CI. 

Proof. "1 =>■ 2". Firstly, we prove that for any £ G T>(S), rj = S£ is linearly dependent 
on £. Otherwise, assume that 77, £ are linearly independent. Since 21 is 2— fold transitive, 
W (a) = [(T^Trj) : T G 21] = [(T£, ST£) : T G 21] C Q(S). It is a contradiction. Suppose 
for £ x , £ 2 in V(S), S£i = Aid, S£ 2 = A 2 £ 2 and 5(6 + £ 2 ) = A(£i + £ 2 ). Then Ai = A 2 = A. 
This implies that S = XI. 

"2 =^> 1" . Suppose for two linearly independent vectors £, rj in TC, {(T£, T77) : T G 21} 7^ 
TC^ . By lemma 1.1, {(T£, Trj) : T G 21} is the graph of a closed, densely defined operator 
S, i.e., ST£ = Trj = TS£. By assumption, S = XI. So 77 = A£. It is a contradiction. 

"1 =>- 3" is obvious. "3 =>■ 1". Let £,77 be linearly independent vectors. Suppose that 
[(T£,Tt7) : T G 21] 7^ H {2 \ by Lemma 1.1, there is a closed, densely defined operator S 
such that g(S) = [(T£,Tt7) : T G 21] = [(T£, 5T£) : T G 21]. For any £ G W, by assump- 
tion of 3, there exist a sequence T n in 21 such that T n £ converges to £ and sup n HT^H < 00. 
We can assume that T n r] weakly converges to z. By Mazur's theorem, there is a sequence 
S n such that S n rj is the convex combination of T n r\ and S n rj strongly converges to z. Note 
that S n £ strongly converges to £. Since SS n £ = S n r) and S is a closed, densely defined 
operator, S( = z. This implies that £ G T>(S). Since £ G is arbitrary, V(S) = TC. By 
closed graph theorem, S is a bounded operator. By Lemma 1.1 and symmetry of £ and 77, 
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S^ 1 is a bounded operator on TC. Thus S is a bounded, invertible operator with inverse 
S^ 1 also a bounded operator. For any A G C, consider vectors £, A£ + 77. Similar arguments 
show that S + XI is a bounded, invertible operator with inverse (5* + XI)^ 1 also a bounded 
operator. So er(S') = 0. It is a contradiction. 



"4 1" . Otherwise, there exist linearly independent vectors £, 77 in 7i such that 
C? = [(T£, Try) : T G 21] 7^ 7Y^ 2 ' ) . Let P be the projection from onto subspace Q. Then 
< P < I and P G Lat2l (2) . By assumption, P G M 2 (C) ® 1. Since P^I, rankP = 1. 
Therefore, there exists a unitary matrix U G M 2 (C) ® CJ such that Q = UPU* = 0©/. Let 

<)-,(<). -^(c)-™. (<).„(«). ff (e).(c 

which implies that ( = 0. Since £, r/ are linearly independent and U is a unitary operator, 
(,u are linearly independent. In particular, £ 7^ 0. It is a contradiction. 

"1 =^ 4". Suppose 21 is 2-fold transitive. Let I 2 ^ P = (P %j ) e M 2 (C)®B(H) such 
that P G Lat^ 2 **. It is easy to see 



PH^ = \/ 



^(2) 



£ ^ £ PW (2) 
?7 



We only need to prove that if P is the projection onto space 



21(2) 



for some £,77 6 H, 



then P G M 2 (C) g)CJ. If £,77 are linearly independent, by assumption 1, P = I 2 . If £,77 
are linearly dependent, then 77 = A£ for some A G C. 



a (2) 



AT£ 



T G 21 



c 

AC 



C G W 



is the closure of the range of the operator 



1 
A 



G M 2 (C)®C7. 



Therefore, P G M 2 (C) ®CJ. 



□ 



By using induction on n and similar idea of proof of Proposition 1.2, we can prove the 
following proposition. 

Proposition 1.3. Let 21 C B(T~C) be a transitive algebra and n G N. Then 21 is n—fold 
transitive if and only if La&S n ^ = LatB(7iY n ' , ^ e -> f or an V projection P G Lat{jCI n ® L), 
P G M n (C) ® CP Furthermore, the strong closure of 21 is B(H) if and only if for any 
n G N, La&F) = LatB(H) (n) . 

Compare with Arveson's characterizations of n—fold transitivity by graph transforma- 
tions (see PQ), the characterization of n—fold transitivity given by Proposition 1.3 is more 
"computable" . 
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2 From n — 1 fold transitivity to n fold transitivity 

Suppose 21 is a transitive algebra on H and 21 is n — 1 (n > 2) fold transitive. By Propo- 
sition 1.3, 21 is n— fold transitive if and only if for any projection P G Lat(C7 n ® 21), 
-P G M n (C)(g)C7. It is interesting to know under what conditions a projection P G 
Lat(C7 n ® 21) implies that P G M n (C) £g> CP In the following, we will provide certain con- 
ditions along this line. 

Recall that for each bounded operator T G B(H), we can associate two closed subspaces 
of TC, the null space {£ G 7i : T£ = 0} and the range space, [T(Ti)], which is the closure 
of the range T(Ti) = {T£ : £ G Ti,}. The corresponding projections are called the null 
projection, denoted by N(T), and the range projection, R(T), respectively. 

(T S \ ( X 

^ ^ | G B(H /C) fte a projection and Z = I y 

B(H /C) . If P G PaiZ, toen #(7\) and 7V(7 - 7\) are in PaiX . 

Proof. Since P is a projection, we have 

71(7-71) = 55*, (1) 

which implies that Pl(5) C R(Ti). If P G LatZ, then we have equation 

TiATi + SYS^ATi. (2) 

Therefore, X(P(7\)) C #(7\), which implies that P(7\) G LatX. 

V£ G AT (7 — Ti), by equation (1), 55*£ = 0, which implies that 5*£ = 0. By equation 
(2), T X X£ = X£, which implies that X£ G AT (7 — Ti). So X(7 - 7\) is in LatX. 

□ 

Corollary 2.2. 7e^2l &e a transitive algebra. Given a projection P = (Pij) nxn G M n (C) ®B{7i), 
if P G La&S n \ then Pa = or Pa = I or P u — Pj a one-to-one self-adjoint operator 
with dense range for 1 < i < n, i.e, N(Pu — Pj) = ana" Pt(Pjj — Pj) = 7. 

Proof. For 1 < % < n, if < P« < 7, then P(P^) ^ and X(7 - P«) ^ 7. Since 21 is a 
transitive algebra, by Lemma 2.1, R(Pu) = I and AT (7 — Pa) = 0. This implies that both 
Pa and I — Pa are one-to-one operators. Therefore Pu(I — Pa) is a one-to-one self-adjoint 
operator. So N{P U - P?) = and P(P l4 - P£) = /. □ 

Lemma 2.3. Pei 21 &e a transitive algebra and n > 2 be a positive integer. Suppose 21 
is (n — I)— fold transitive and P = (Pij) nxn G M n (C) ®B{Ji) is a projection in Lat%^ n \ 

Write P = ^ ^ g i3(7i( m )07i^ m )) ; wnere 1 < m < n - 1. 7/72(7\) ^ J m or 

X(7 m - Ti) ^ m; £nen P G M n (C) <g> CP 
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Proof. By Lemma 2.1, R(Ti),N(I — Ti) G LatSt'-" 1 -'. By assumption and Proposition 1.3, 
there exist projections Qi, Q 2 G M m (C) <8> C7 such that Q\ = R(Ti) and Q 2 = N(I m — Ti). 

If -R(Ti) 7^ 7 m , rankQi < m — 1. Since Qi G M m (C)<g)C7, there exists a unitary 
operator Pi G M m (C) ®C7 such that 

^iQi^i* = O fc 0/ m _ fc , 

where 1 < k < m. Let Wi = Pi 7 n _ m . Note that Wi(J n <g> Z)W7 = (4 <g> Z), for any 
Z G 21. Therefore, W^PW^* G Lat2lH Since P G M n (C) ®C7 if and only if ^P^* G 
M n (C) ®C7, we can assume P(Ti) = Ofc07 m _ fe . This implies that Pq = and therefore 
P u = p n = for all 1 < i < n. So 

and therefore Pi G Lat2l (n_1) . By assumption, P 1 G M n _i(C) <g) C7 and therefore P G 
M n (C)(g)C7. 

If iV(7 m — Ti) 7^ m , rankQ 2 > 1- Since Q 2 G M m (C)®C7, there exists a unitary 
operator U 2 G M m (C) <g>C7 such that 

U 2 Q 2 U 2 = h' Om-k', 

where fc' > 1. Let W 2 = P 2 07 n _ m . Note that W 2 (7 n <g> Z)W 2 * = (7 n <g> Z), for any 
Z G 21. Therefore, W/ 2 PW/ 2 * G Lat2lH Since P G M n (C) ®C7 if and only if W 2 PW% G 
M n (C) (g>C7, we can assume N(I( m ) — Ti) = 7 fe / 0O m _ fc /. This implies that P n = 7 and 
therefore Ph = Pn = for all 1 < i < n. So 

and therefore P 2 G Lat2l^ n_1 \ By assumption, P 2 G M n _i(C) <g) 1 and therefore P G 
M n (C)d)C/. □ 

Lemma 2.4. 7e£ 21 &e a transitive algebra and n > 3 be a positive integer. Suppose 21 
is [n — I)— fold transitive and P = (Pj) nX n G M„(C) ®B(Ti) is a projection in Lat$[( n K 

Write P=^l t ) e BfHS^ 1 '). 7/t/ie rarepe o/Ti W, toen P G M n (C) ®C7. 

Proof. Assume P ^ M n {C)®€L By Corollary 2.2 and Lemma 2.3, both 7\ - Tf and 
T 2 — T 2 2 are one-to-one operators with dense ranges. By assumption, 7\ is an invertible 
operator and therefore T-f 1 G B(T~t). Since P is a projection, we have Ti — T 2 = S'S'* and 
T 2 -T 2 2 = S*S. Let 5 = U\S\ be the polar decomposition. Then H O^" 1 ) = P(Ti-T 2 ) = 
#(S) = PP* and O©^"- 1 ' = P(T 2 - T 2 ) = P(S*) = U*U. Hence, P = (Pi, • • • , P n _i) 
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is a unitary operator from H {n ~ l) o nto H O^" 1 ) such that R{T X - T?) 
R(T 2 - T|) = U*U. Let H = y/T-^-Tf. It is easy to see 



UU* and 



P 



( T\ HU X 



RVn-l \ 



{U^H UU(I~Ti)U 2 ■■■ UU{I-Ti)U n ^ ) 



( I 



\ ( T x H 
H J-Ti 



H \ 

I-Ti 



\ U*_ x ) \ H I-Tt ■ 

For every ^ £ G 7i, we have 



Ut 



\ 



Therefore, 



Ti H 
H I-T x 



U*H UKl-TjUi 



-T{ l HU^ 



-UlT{ l HU x £ 



which implies that N 



Tl 



U{H Ul{I-T x )U x 
7^ 12- By Lemma 2.3, P G M n (C) ®C7. It is a contradiction. 



7^ 2 and therefore R 



□ 



As a corollary of Proposition 1.3, Lemma 2.3 and Lemma 2.4, we get Foias' result 
(Proposition 5 of [H]): 

Corollary 2.5. (Foias' Theorem) Let %i be a transitive algebra on a Hilbert space Ti. 7/21 
has no nontrivial invariant operator ranges, then 21 is strongly dense in B{7i). 



3 On transitive algebras containing a standard finite 
von Neumann subalgebra 

Theorem 3.1. Let M. be a finite von Neumann algebra acting on a Hilbert space Ti and 
21 be a transitive algebra which contains M! . 7/21 is 2— fold transitive, then 21 is strongly 
dense in B(TC). 

Proof. We need to prove that 21 is n— fold transitive for n G N. We use induction on 
n. Suppose 21 is n— fold transitive for n > 2 but 21 is not n + 1 fold transitive. By 
Proposition 1.3, let P = (P^) G M n+1 (C) <g> B(H) be a projection such that P G Lat2l (n+1) 
but P M n+ i(C) <g> CL Note that M C 21, P G Lat.M /(n+1) . Since .A/f is a von Neumann 
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algebra, P E M n+l {C)®M. Write P = y gl t 2 ) E B ( n ® n(n) )- B ^ Corollary 

2.2 and Lemma 2.3, R(Ti - If) = H0OW and R(T 2 - T|) = 0©H (n) . Since P is a 
projection, we have Ti(J — Ti) = S'S* and T 2 (7 — T 2 ) = S^S*. By polar decomposition, 
there is a unitary operator U = (U 2 , ■ ■ ■ , C/ n +i) from onto 0^ such that 



1717* = J0O n , (3) 

17*17 = O0/ n . (4) 

By equation (3) and (4), 7 0O n and O07 n are equivalent in M n+ i(C) <E> M. Since 

M n+ i (C) ® A4 is a finite von Neumann algebra, it is a contradiction. □ 



Corollary 3.2. Let M. be a standard finite von Neumann algebra on a Hilbert space 7i and 
21 be a transitive algebra which contains M.. If 21 is 2— fold transitive, then 21 is strongly 
dense in B{Ti). 

Corollary 3.3. (Arveson's Theorem) Let 21 C B{Ti) be a transitive algebra which contains 
a MAS A ofB(H). Then 21 is strongly dense in B(H). 

Proof. By Theorem 3.1, we need to prove that 21 is 2— fold transitive. Assume 21 is not 
2— fold transitive. By Proposition 1.2, there is a non-scalar, closed densely defined operator 
S such that TS = ST for every T e 21. Since 21 contains a MASA A of B(7i), S is affiliated 
with A. So S is a (unbounded) normal operator. Since S is not a scalar, there is a non- 
trivial spectral projection E of S. By Fuglede's theorem [Fu], ET = TE for all T e 21. 
Since 21 is a transitive algebra, it is a contradiction. □ 

Corollary 3.4. Let A4 fre a type Jii factor with a faithful normal trace r . If '21 is a 
transitive subalgebra of B(L 2 (Ai, r)) which contains M.' and a MASA of M., then 21 is 
strongly dense in i3(L 2 (A4, r)). 

Proof. Suppose A is a MASA in M. and 21 is a transitive algebra which contains A and 
A4'. By Theorem 3.1, we need to prove that 21 is 2— fold transitive. Let L be the von 
Neumann algebra generated by A and A4'. Then L' = A' C\ Ai = A. Let S be a closed, 
densely defined operator such that ST = TS for every T e 21. Then 5 1 is affiliated with 
A Similar arguments as the proof of Corollary 3.3 show that S = XI for some A. By 
Proposition 1.2, 21 is 2— fold transitive. □ 

Remark: Let M. be a type II\ factor and A be a MASA in M.. Let L be the von Neu- 
mann subalgebra of B(L 2 (M, r)) generalized by „4, and M 1 . Does L contains a MASA of 
B(L 2 (M, r))? It seems that A4 = LF 2 and A be the MASA generated by one generator is 
a counterexample. 

Combine Corollary 3.2 and Proposition 1.2, we have the following corollary. 

Corollary 3.5. Let M. be a type II\ factor with a faithful normal trace r. Then the 
following conditions are equivalent: 
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1. for every non scalar, closed, densely defined operator S affiliated with AA, {S}' PI 
B(L 2 (AA,t)) has a nontrivial invariant subspace (affiliated with AA); 

2. every transitive algebra on L 2 (AA, r) containing AA is strongly dense in B(L 2 (AA,r)). 

Lemma 3.6. Let AA be a finite von Neumann algebra and T E AA be a normal operator, 
i.e., TT* = T*T. If E G LatT n AA, then ET = TE. In particular, E G LatT* . 

Proof. Let E G LatT. With respect to E, I — E, we can write T = ^ ^ j, Now we 
have the following 



A B \ f A* \ _( AA* + BB* BC* 
C J \ B* C* J ~ \ CB* CC* 

A* \ / A B \ _ / A* A A*B 
B* C* { C ) ~ [ B*A B*B + C*C 



By TT* = T*T, AA* + BB* = A* A. Let r be the unique center- valued trace on M. 
Apply trace te induced by r on EA4E, we get r E (BB*) = 0. This implies that B = and 
ET = TE. □ 

Corollary 3.7. Let M. be a finite von Neumann algebra acting on a Hilbert space 7i and 
T G M. be a normal operator. If% is an algebra (not necessarily transitive) containing AA' 
and T e 21, then T* is in the strong closure of 21. 

Proof. For n e N, let E G Lat2l (n) . Then E G LatM' {n) and E G LatT^ . Hence E G 
LatT (n *> n (M„(C) (8) .M). Since is a normal operator in M n (C) g> M and M n (C) ® 
is finite, E G LatT*( n > by Lemma 3.6. By Theorem 7.1 of [R-R], T* is in the strong closure 
of 21. □ 

The following question asked by Radjavi and Rosenthal [21] remains open: If 21 is a 
transitive algebra generated by normal operators, is 21 strongly dense in B(7t)7 But we 
have the following result. 

Corollary 3.8. Let M. be a type Hi factor with a faithful normal trace r. If 21 is a 
transitive subalgebra of B(L 2 (Ai, r)) generated by normal operators in M. and by AA' , then 
21 is strongly dense in B(L 2 (A4, r)). 

Proof. Suppose 21 is generated by {T a } C A4 and AA', where T a T* = T*T a . By Corollary 
3.7, the strong closure of 21 contains the von Neumann algebra L generated by {T a } C AA 
and AA'. Since L is transitive, L = B(L 2 (AA, r)). □ 
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4 Non-selfadjoint algebras related to free products of 
finite von Neumann algebras 

The main results of this section are Theorem 4.1 and Corollary 4.2. Examples (Example 
4.9) related to free group factors are given at the end of this section. 

Theorem 4.1. Let (A4, r) be a finite von Neumann algebra with a faithful normal trace r. 
Suppose Af C M. is a von Neumann subalgebra and Z G M. satisfy the following conditions: 

1. Z ^ and t(Z) = 0; 

2. Z,Z((Af' n M)eCl),((Af' D M)eCl)Z are mutually orthogonal in L 2 (M,r). 

Let 21 C B(L 2 (A4,t)) be the algebra generated by Z,Af and M.' . Then 21 is a transitive 
algebra and strongly dense in B(L 2 (A4, r)). 

Corollary 4.2. Let (AAi, t±), (AA.2, T2) be finite von Neumann algebras and A4 = (M.i,Ti)* 
(M.2, T2) be the reduced free product von Neumann algebra and r be the induced faithful 
normal trace on A4. Suppose M C A4i is a diffuse von Neumann subalgebra and Z e M.2 
is not a scalar. In B(L 2 (A4, r)) ; let 21 be the algebra generated by Z , Af and M. . Then 21 
is a transitive algebra and strongly dense in B(L 2 (A4,t)). 

To prove Theorem 4.1, we need to prove the following auxiliary lemmas. 

Lemma 4.3. Let (A4,t) be a finite von Neumann algebra with a faithful normal trace 
t and M C A4 be a von Neumann subalgebra. Suppose Z G A4 satisfy r(Z) = 
and Z, Z((Af' H M) 0C1), ((Af' n M)QCl)Z are mutually orthogonal in L 2 (M,r), i.e, 
t(ZXZ*) = t(Z*XZ) = r(Z*XZY) = for any X, Y G Af' n M and r(X) = r(Y) = 0. 
Then VA, B, C, D G Af' n M, we have 

t((AZB)*(CZD)) = t(A*C)t(B*D)t(Z*Z). (5) 

Proof. Write A*C = X + t(A*C)1 and D*B = Y + t(D*B)1, where X, Y G Af' n M and 
t(X) = t(Y) = 0. Then 

t((AZB)*(CZD)) 
= t(B*Z*A*CZD) 
= t(Z*(A*C)Z(DB*)) 
= t(Z*(X + t(A*C)1)Z(Y + t(DB*)1)) 

= t(Z*XZY) + t(Z*XZ)t(DB*) + t(A*C)t(ZYZ*) + t(A*C)t(Z* Z)t(DB*) 
= t(A*C)t(Z*Z)t(B*D). 

□ 

Corollary 4.4. With same assumption of Lemma 4-3, Wl, B G Af'nAA, AZB = implies 
that A = or B = or Z = 0. 
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Corollary 4.5. With same assumption of Lemma 4-3 and assume Z ^ 0. Then VA, B,C,D G 
Af'nM, r((AZP)*(CZP>)) = z/anrf or% ifr{A*C) = orr(B*D) = 0. 

Lemma 4.6. With same assumption of Lemma 4-3 and assume Z ^ 0. For any positive 
integer n, let P = {P ij ) 2 x2 e M 2 (C) (^(jV' n .M) 6e a projection. If P G Lat(I 2 g> Z), i/ien 
P G M 2 (C)®CI. 

Proof. P(/ 2 ® Z)P = (I2® Z)P implies the following equation 

P 11 ZP 11 +P l2 ZP 21 ^ZP 11 . (6) 

For Pn,P 12 , by the Gram-Schmidts orthogonal process (with respect to r), we have 

P11 = an, (7) 
P12 = ai 2 xi+x 2 , (8) 

where xi,x 2 G A/"' PI M. are orthogonal in L 2 (A4,t), i.e, r^a^i) = and cti 2 G C. By 
taking * of equation (7), (8), we have 

P n = x* v (9) 
P21 = a 12 xl + x* 2 , (10) 

where x\,x* 2 G JV 7 D M are orthogonal in L 2 (M,t). Plug equations (7), (8), (9), (10) in 
equation (6), we have 

(1 + \ai2\ 2 )xiZx\ + x 2 Zx* 2 + ai 2 x\Zx*2 + ol\ 2 x 2 Zx\ = Zx\. (11) 

By Corollary 4.5, x 2 Zx* 2 is perpendicular with x\Zx\, X\Zx\, x 2 Zx{ and Zx\. There- 
fore, x 2 Zx* 2 = 0. By Corollary 4.4, we have x 2 = 0. So equation (11) implies that 

(1 + |ai 2 | 2 )a;iZX| = Zx\. 

By Corollary 4.4, either x\ = G C or X\ = G C. Therefore Pn = xi G C, 

Pi 2 = a 12 Xi and P 2 i = P\ 2 £ C. By symmetry, we have P 22 G C, which implies that 
P G M 2 (C)(8) CI. ' □ 

Proof of Theorem 4-1- Let L be the von Neumann algebra generated by Af and A4' 
and P G be a projection such that P G LatSl. Then P G A/" n M. Since P G LatZ, 

we have (I — P)ZP = 0. By assumptions of Theorem 4.1 and Corollary 4.4, P = / or 
P = 0, which implies that 21 is a transitive algebra. If Q G M 2 (C) (g> B(L 2 (M, r)) is a 
projection such that Q G Lat(/ 2 (§) 21), then Q G Lat(/ 2 £§>L). Since L is a von Neumann 
algebra, Q G (7 2 ®L)' = M 2 (C)®L' = M 2 (C) ®(J\f DM). Note Q G Lat(J 2 ® Z). By 
Lemma 4.6, Q G M 2 (C)®CP By Proposition 1.2, 21 is 2— fold transitive. By Theorem 
3.1, 21 is strongly dense in B(L 2 (M, r)). QED 



The following lemma is proved by Popa in [20] . 
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Lemma 4.7. Let B be a diffuse von Neumann subalgebra of a finite von Neumann algebra 
M {with a faithful normal trace r) and U be a unitary operator in M. If UBU* and B 
are orthogonal with respect to r , then U is orthogonal to {V G M : VBV* = B, VV* = 
V*V = I}, the set of normalizers of B in M. In particular, U is orthogonal to B' D M . 

The following result is well known. For the sake of completeness, we include the proof 
in the following. Our proof follows Popa's idea in |20j . 

Lemma 4.8. Let (Mi, Ti), (M 2 , T 2) be finite von Neumann algebras and M = (Mi, Ti) * 
(M 2 , t 2 ) be the reduced free product von Neumann algebra and r be the induced faithful 
normal trace on M. Suppose N is a diffuse von Neumann subalgebra of Mi, then Af'nM = 

Proof. We only need to prove W D M C Af' fl Mi. Let Mi,M 2 be the set {T G Mi : 
ri (T) = 0} and {T G M 2 : r 2 (T) = 0}, respectively. Note that L 2 (M,r) is the closure 
of CI © Mi © M 2 © Mi ® M2 © M 2 <S> Mi © • • • . To prove Af'nM C JsP n A^i, we 
only need to prove M 2 ,Mi © -M 2 , -M2 © -Mi, • • • are orthogonal to W fl A^i- Note that 
Mi and 7V1 2 are the closure (with respect to strong operator topology) of linear span of 
{U E Mi: Ti{U) = 0, UU* = U*U = 1} and {V E M 2 : r 2 (V) = 0, VV* = V*V = I}, 
respectively. We need to prove the following words: U1V1 ■ ■ ■ U n V n , U1V1 ■ ■ - U n (n > 2), 
ViUiV 2 U 2 • ■ • , are orthogonal to Af' fl Mi, where Ui, U 2 , ■ ■ ■ and Vi, V 2 , ■ ■ ■ are unitary 
operators in Mi and M 2 , respectively. Note that U1V1 ■ ■ • U n V n MiV*U* ■ ■ • VfU* and 
Mi are orthogonal in L 2 (M, r). Von Neumann algebra U1V1 ■ ■ ■ U n V n MV*U* ■ ■ ■ V{U± 
and Af are orthogonal with respect to r. By Lemma 4.7, U1V1 ■ ■ ■ U n V n is orthogonal to 
Af' fl M. Similarly, we can prove other cases. □ 

Proof of Corollary We can assume Z / fl and r(Z) = (Otherwise, consider 
Z - t(Z)). By Lemma 4.8, Af' H M = Af' n Mi and therefore Z is free with Af' H M. 
So Z, Z((Af' nM)Q Cl), ((Af' n M) © Cl)Z are mutually orthogonal in L 2 (M, r). By 
Theorem 4.1, 21 is a transitive algebra and strongly dense in B(L 2 (M, r)). QED 

Example 4.9. Let M = L¥ n (2 < n < 00) be the type Hi factor associated with the left 
regular representation A of the free group ¥ n on n generators and a, h be two generators 
of F n . Let k be a positive integer and Z G {\(a), \(a)*}" be a nonscalar operator. By 
Corollary 3.7 and Corollary 4-2, the algebra 21 on L 2 (M, r) generated by Z, \(b) k , and M' 
is a transitive algebra and strongly dense in B(L 2 (M,t)). 

5 Non-selfadjoint algebras related to (M 2 (C), ±Tr)*(M 2 (C), \Tr) 

Let M = (M 2 (C), \Tr) * (M 2 (C), \Tr) be the reduced free product von Neumann algebra 
with respect to the normalized trace on M 2 (C). Then M is a type Hi factor with a faithful 
normal trace r. Let (Eij) i . =1 2 and (i^j) i3 - =1 2 be the matrix units in (M 2 (C), \Tr) * 1 and 
1 * (M 2 (C), \Tr), respectively. Consider the following subalgebras of B(L 2 (M,r)): 



15 



1. 2li, the algebra generated by E u , E 12 , F n and M.'; 

2. 2l 2 , the algebra generated by E n , Ei 2 , F± 2 and M!\ 

3. 2l 3 , the algebra generated by En, F 12 and M.'; 

4. 2l 4 , the algebra generated by E u , F 12 and M.' . 

We have the following questions: For 1 < % < 4, is 2lj a transitive algebra? If 2lj is a 
transitive algebra, is % strongly dense in B(L 2 (M, t)))? In this section we will prove the 
following results. 

1. 2li is a transitive algebra and strongly dense in B(L 2 (M, r)). 

2. 213,214 are not transitive. The invariant subspaces of 2I3 and 2I4 are abundant. 
The question on 2l 2 remains open! 

To prove our main results, we need to introduce the following operators. In (M 2 (C), \Tr)* 
1, let 

w ° = (l i)' w >=(l -i)^=(? "oj.^-f! J)' 

Then we have 

1. ^2 = w| = ^2 = Wq . 

2. WiW 2 = -W 2 Wi = -W 3 , W X W 3 = -W 3 W 1 = -W 2 , W 2 W 3 = -W 3 W 2 = -Wi; 

3. W , Wi, W 2 , W 3 form an orthonormal base of L 2 ((M 2 (C), \Tr) * 1, r). 
Similarly, in 1 * (M 2 (C), \Tr), let 

«-(5!).«-(!-°.).h-(^ 1 ).«-(!J). 

Then we have similar equations and M. is the von Neumann algebra generated by {Wo, Wi, 
W 2 , W 3 }*{V , V 1 ,V 2 ,V 3 }. 

5.1 The case of 2ti 

Let W = W 1 , V = Vi and [/ = WF. Then [/ is a haar unitary operator in M. Let .4. 
be the von Neumann algebra generated by U and U*. The following lemma is an easy 
exercise. 

Lemma 5.1. A is a MASA of M. 
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Theorem 5.2. Let (M,t) and A be as above. For Z G (M 2 (C),±7V) * I, let 21 be the 
algebra generated by Z,A and A4' in B(L 2 (A4,r)). Then 21 is a transitive algebra if and 
only if Z {W}" . In this case, 21 is strongly dense in B(L 2 (A4, r)). 

Corollary 5.3. 2li is a transitive algebra and strongly dense in B(L 2 (Ai, r)). 

We need the following lemmas. 

Lemma 5.4. With the same assumption of Theorem 5.2 and assume Z = \W for some 
A G C. Then 21 is not transitive. 

Proof. We can assume Z = W. Then 21 is a von Neumann algebra. Note 

[U + U*)W = (WV + VW)W = WVW + V = WVW + W 2 V = W(U + [/*). 
So U + U* G 2t' , which implies that 21 is not transitive. □ 

Lemma 5.5. With the same assumption of Theorem 5.2 and assume Z ^ and t(Z) = 
t(Z*W) = 0. Then 21 is a transitive algebra and strongly dense in B(L 2 (A4, r)). 

Proof. Note t(Z*V) = and W* = W. It is easy to verify 

r{Z{WV) n Z*) = r(Z*(WV) n Z) = r((WV) n Z{WV) m Z*) = 

for all m,n G Z/{0}. Since A CI is generated by (WV) n for all n G Z and n^O, 
Z,Z(AeCl),(AeCl)Z are mutually orthogonal in L 2 (M,r). Since A is a MASA of 
M, A f] M = A. By Theorem 4.1, 21 is a transitive algebra and strongly dense in 
B(L 2 (M,r)). □ 

Lemma 5.6. With the same assumption of Theorem 5.2 and assume Z = W + X,X^0 
and t(X) = t(X*W) = 0. Then 21 is transitive. 

Proof. Let P G B(L 2 (M, r)) be a projection such that P G Lat%. Since 21 contains A and 
.A/f, P G {^4., A^'}' = .4' n M = A By identifying M as a subset of L 2 (M,r), we can 
write P = Xl^-oo ^nU n , where A n = A_ n . Since P G LatZ, we have PZP = ZP. Thus, 
we have the following equation. 

XmXnU m WU n + *m\nU m XU n = ^ A„ + ^ A„XfT . 

m,n£Z m,?ieZ neZ neZ 

It is easy to verify that U~ n XU n , n G Z/{0} are mutually orthogonal in L 2 (M,t) 
and perpendicular to U l WU m , U r XU s , WU m , XU m for all l,m,r,s G Z and r 7^ — s. 
Therefore, for n 7^ 0, the coefficients of U~ n XU n are zero, i.e, |A„| 2 = 0, which implies 
that A n = 0, Vn G Z/{0}. So P = A P Since P = P* = P 2 , P = or I. This implies that 
21 is transitive. □ 
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Proof of Theorem 5.2. If Z = XI, then 21 is the von Neumann algebra generated by 
A and M'. So 21 is not transitive. If Z G {iy}" and Z 7^ A/, then 21 is the algebra 
generated by W, 21 and .M'. By Lemma 5.4, 21 is not transitive. Assume that Z ^ {VF}". 
We can assume that Z ^ and t(Z) = 0. Write Z = aW + X, where X 7^ and 
r(X) = r(X*W / ) =0. If a = 0, by Lemma 5.5, 21 is a transitive algebra and strongly 
dense in B(L 2 (A4, r)). If a 7^ 0, we can assume a = 1. By Lemma 5.6, 21 is transitive. By 
Lemma 5.1 and Corollary 3.4, 21 is strongly dense in B(L 2 (Ai, r)). QED 

5.2 Brown measures of W\ + F12 and £12 + F12 

The following observations are crucial to prove that 2I3 and 2I4 are not transitive: 2l 3 C 
{{W\ + F12) 2 }' and 2l 4 C {{E12 + F12) 2 }' ■ So we only need to prove that the support of 
Brown measures of (Wi + -F12) 2 and (£"12 + -^12) 2 are not single point and then conclude the 
existence of nontrivial hyperinvariant subspaces of {W\ + F i2 ) 2 and (Eu + Fi 2 ) 2 by [14"] . 

5.2.1 Brown measures of R— diagonal operators 

Let M. be a finite von Neumann algebra with a faithful normal trace r. The Fuglede- 
Kadison determinant ( pH]) of T G .M is defined by 

A(T) =exp[r(ln(T*T)^)] 

is a generalization of a determinant of a finite matrix. 

The Brown measure ( [1]) ht of the element T is a Schwartz distribution on the complex 
plane defined by 

U Ai = M n (C) and r = -Tr is the normalized trace on M n (C), then /i^ is the normalized 
counting measure - (5ai + <5a 2 • • • + 5a„), where Ai, A2 • • • , A„ are the eigenvalues of T re- 
peated according to root multiplicity. If T is normal, fiT is the trace r composed with the 
spectral measure for T. From the definition, Brown measure /i^ only depends on the joint 
distribution of T and T*. 

The Brown measure has the following properties (see [1]): /it is the unique compactly 
supported measure on C such that In A[T — (x + iy)I] = f c In \z — X\djjiT{z) for all A G C. 
The support of fir is contained in cr(T), the spectra of T. /i^b = Hba for arbitrary A, £? 
in .M, and if f(z) is analytic in a neighborhood of /U/(T) = (^t)/- If G 7V1 is a 

projection such that E G LatT, then with respect to E,I — E we can write 

T = ( A B ) 

\ c y ' 



where A = ETE and C — (I — E)T(I - E) are elements of the i7i factor M t = EME 
and M.2 = (I — E)M.(I — E). Let \ia and fic be the Brown measure of A and C computed 
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relative to M. x and A4 2 , respectively, then fj, T = o>ha + (1 — at)y>Ci where a = r(E). 

R— diagonal operators are introduced by Nica and Speicher in [T7j. Recall that an 
operator T in a non-commutative probability space is an R— diagonal operator if the 
R— transform R^{t,t*) of the joint distribution /i(T, T*) of T,T* is of the form 

oo oo 

Rn(T,T*){Zl, Z 2 ) = ^ a n(ZlZ 2 ) n + ^ M^l)"- 
n=l n=l 

Nica and Speicher [17] proved that T is an R— diagonal operator if and only if T has same 
*-distribution as product UH, where U and H are *-free random variables in some tracial 
non commutative C*-probability space, U is a Haar unitary operator and H is positive. 
In [13] . Haagerup and Larson explicitly computed the Brown measures of R— diagonal 
operators in a finite von Neumann algebra. 

Theorem 5.7. (Theorem 4.4 of [H]) Let U,H be *-free random variables in (A4,t), with 
U a Haar unitary operator and H a positive operator such that the distribution fin of H 
is not a Dirac measure. Then the Brown measure huh of UH can be computed as the 
following. 

1. huh is rotation invariant and its support is the annulus with inner radius ||-f^ _1 ||2 1 
and outer radius \\H\\2- 

2. {JLuh{{0}) = MM) and fort e}fi H {{0}),l}, 

H UH (B (0, (^ H2 (t-l))~ 1/2 )) = t , 

where S^ h2 is the S— transform of H 2 and B(0, r) is the closed disc with center and 
radius r; 

3. huh is the only rotation invariant symmetric probability measure satisfying 2. 

Based on Theorem 5.7, the Brown measure of the sum of a random variable with an 
arbitrary distribution and a free R— diagonal element, e.g, U n + Uoo, where U n and are 
the generators of Z n and Z respectively in the free product Z n * Z, is computed by Biane 
and Lehner in [3]. 

5.2.2 Brown measure of WiFi 2 

Lemma 5.8. T = W\F\ 2 is an R— diagonal operator with Brown measure ht satisfying: 

1. Ht is rotation invariant and the support of Ht is B ^0, 

2. dji T {z) = \5 Q + ^ 2)2 drdO for z = re td and < r < 4=. 
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Proof. Note that F X2 = V 2 F 22 . Since W x and V 2 are free unitary operator such that 
t{Wi) = t(V 2 ) = 0, simple computations show that U = W X V 2 * is a Haar unitary operator. 
To prove T is an R— diagonal operator, we only need to check that U is *-free with F 22 . 
Note that F 22 is in the algebra generated by V x , we only need to prove that U is *-free with 
Vi. Note that V? = I and r(Vi) = 0. We need to check T(U ni V x U n *V x U n3 ■ ■ ■ V X U^) = 0, 
where ni,n 2 , • • • ,rik £ Z and n 2 , • • • , rifc_i are not equal 0. Consider the word U l V]_U m , 
I, m 7^ 0. We have the following four cases: 

1. If I, m > 0, then U l V x U m = W X V 2 * ■ ■ ■ W X (V 2 *V X )W X V 2 * ■ ■ ■ W X V 2 *; 

2. If I > 0, m < 0, then C/'lW™ = W^K,* • • • W X (V*V X V*)W X V* ■■■W 1 ; 

3. If I < 0, m > 0, then U l V x U m = V 2 *W X ■ ■ ■ W X V X W X V 2 * ■ ■ ■ W X V 2 *; 

4. If I < 0, m < 0, then L^lW m = F 2 Wi • • • W X (V X V 2 *)W X V 2 * ■ ■ ■ W x . 

Note that t{V*V x ) = t(V*V x V*) = t(V x V*) = 0. U ni Vjj r ^V 1 U n3 ■ ■ ■ V x U nk is an alter- 
nating product of centered elements from (M 2 (C), \Tr) * 1 and 1 * (M 2 (C), \Tr). Thus 
T(U ni V x U n2 V x U n3 ■ ■ ■ V x U nk ) = 0. This proves that T is an i?-diagonal operator. 

Now we apply Theorem 5.7 to compute the Brown measure of T. Note that H = F 22 
and H-F22II2 = { r {.F 22 )) 1 ^ 2 — 73- Since the kernel of F 22 is nontrivial, H-F^H^ 1 = 0- By 1 
of Theorem 5.7, we obtain 1 of Lemma 5.8. By 2 of Theorem 5.7, //r(0) = /-tff(O) — \- To 
compute the density function of Brown measure of T, we first compute the S— transform 
of H 2 = H = F 22 . Simple computation shows that S^ h2 (u) = 2 2 ^r^ ■ By 2 of Theorem 5.7, 

t = liT (B (0, {S, R2 (t - 1))~ 1/2 )) = ipt (B (0, y/l^t)) for t 1]. Let r = y / T^. 

Then i = 2 (i- r 2) an< ^ (B (0) r )) — 2(i-r 2 ) f° r < r < -^=. This implies 2 of Lemma 
5.8. "'' ' ' V ~ □ 

The following lemma is useful to compute the Brown measures of E X2 +F 12 and W X +F X2 . 

Lemma 5.9. Let M = 1 * (M 2 (C), \Tr). Then W X NW X is free with M. 

Proof. Consider an alternating product of elements of W X MW X and M: A x (W X B X W X )A 2 (W 2 B 2 
W 2 )A 3 ■ ■ ■ (W x B n _ x W x )A n , where A 2 , • • • , A n _ x , B x , • • • , B n _ x are centered elements in Af 
and A x ,A n are either centered elements or 1. Then it an alternating product of elements 
of (M 2 (C), \Tr) * 1 and M = 1 * (M 2 (C), \Tr). Thus the trace is 0. □ 

Since the Brown measure of T only depends on the joint distribution of T and T*, the 
Brown measures of E X2 +F X2 and W X +F X2 are same as the Brown measures of W X F X2 W X +F X2 
and W X V X W X + F X2 , respectively. 
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(A B* \ 
g (7 ) • Since W 2 = I, we have 



1 \ _ f A B*\( A B* \ _ f A 2 + B*B AB* + B*C 
1 J [ B C [ B C J { BA + CB C 2 + BB* 



Hence, 



CB = BA. (12) 



5.2.3 Brown measure of E 12 + F 12 



Since H(e 12 +f 12 ) = f I (w 1 F 12 w 1 +F 12 ), we need to compute the Brown measure of W\F 12 W\ + 



F 12 . Note that {W^W^F^f = W X F X2 W X F X2 +F X2 W X F X2 W_ 



A B* \ / I \ ( A B* 
B C j I j [ B C 



I \ (0I\(AB*\(0I\(AB*\ f B 2 AB + BC 
) + \ J \ B C J \0 J \ B C J ~ \ B 2 
Brown measure of (WiFi 2 Wi + -F 12 ) 2 is same as the Brown measure of B 2 and the Brown 
measure of W±F 12 Wi + F 12 is same as the Brown measure of B (because Brown measures 
of W\F\ 2 W\ + F12 and B are both rotation invariant). Now we only need to compute the 
Brown measure of B. Note that 



W-]_F] 



12 



A 
B 



Thus fi\ViF 12 — + \^b- By Lemma 5.7, we conclude that hb is rotation invariant and 
the support of /i£ is B ^0, -^j and cIhb(z) = ^ jy^zyi drdO for z = re ld and < r < 
Summarize above, we have the following proposition. 

Proposition 5.10. Let H(e 12 +f 12 ) be the Brown measure of E\ 2 + F i2 . Then we have the 
following 

1. fi(E 12 +F 12 ) is rotation invariant and the support of H(e 12 +f 12 ) is 

2. dn( El2 +F 12 )(z) = \ drdQ for z = re %e and < r < ^. 

Corollary 5.11. Let H(e 12 +f 12 ) 2 be the Brown measure of (E 12 + F 12 ) 2 . Then we have the 
following 

1. H(e 12 +f 12 ) 2 is rotation invariant and the support of H(e 12 +f 12 ) 2 is B (0, |); 

2. d/J, iEl2 +F 12 ) 2 (z) = iZ r(.l-r)* drdd f° r Z = reld afld0 - 1 " ~\- 
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5.2.4 Brown measure of W\ + F 12 

Since /j,(w 1+ f 12 ) — ^{w^w^+f^)^ we nee d to compute the Brown measure of W1V1W1 + F 12 . 
We compute the Brown measures of (WiVlWi + F 12 ) 2 first. Note that (VKiViWi + F 12 ) 2 = 

h + WlVlWlFl2 + FaWlVlWl = h+(g c ) ( o -i)(b c ) ( o ) + 

I \ f A B* \ f I \ / A B* \ _ f 1 + 2BA A 2 - B*B + BB* - C 2 
J \ B C J \0 -I J \ B C ) ~ \ I + 2BA 

the last equation follows by (12). So the Brown measure of {WiFi 2 W\ + F12) 2 is same as 
the Brown measure of 1 + 2B A. Now we only need to compute the Brown measure of 25 A 
Note that 

A 2 -B*B 
2BA 



W X V X W X F X2 



Since W1V1W1 is *-free with F i2 , fJiwiFu — HWiVxWiF 12 = + \^2BA- By Lemma 5.7, 

we conclude that fi 2 BA is rotation invariant and the support of fi 2 BA is B ^0, -j=\ and 

d^2BA(z) = ~ (i__ r 2-j2 drd9 for z = re 10 and < r < -j=. Summarize above, we have the 
following proposition. 

Proposition 5.12. Let fir^+F^) 2 be the Brown measure of (Wi + F 12 ) 2 . Then we have 
the following 



1. yU(y[/ 1+ ir 12 )2 is rotation invariant with respect to 1 and the support of H(w 1+ f u ) 



2 is 



M 1 ^ 

2. dfi {Wl+Fl2 )2(z) = \ y^zyz drdO for z - 1 = re 10 and < r < 

Since the joint *— distribution of W± + -F\ 2 , (Wi + F12)* and the joint *— distribution of 
— (Wi + F12), — (Wi + F12)* are same. We have the following corollary. 

Corollary 5.13. Let ^(Wi+Fu) be the Brown measure of W\ + F\ 2 . Then the support of 
V(w 1+ f 12 ) is jz E C : \z 2 - 1| < ^-}. 

5.3 The case of 2t 3 

Theorem 5.14. 2I3 zs noi a transitive algebra. Indeed, for any < r < 1, there is a 
projection E r a M. such that r(E r ) = r and E r e La£2l 3 . 

Proof. 2I3 is the algebra generated by Wi,Fi 2 and .M'. Simple computation shows that 
Wi(Wi + F 12 ) 2 = (V^ + F 12 ) 2 Vi and F 12 (^ + F 12 ) 2 = {W l + F 12 ) 2 F 12 . So 2l 3 C 
{(Wi + F 12 ) 2 }'. Let < r < 1. By Proposition 5.12, there is s, < s < such 
that /X(vk!+f 12 ) 2 (B (1, s)) = r. By Theorem 7.1 of [H], there is a hyper invariant subspace 
E r in A4 of (Wi + F 12 ) 2 such that r(E r ) =r. □ 
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5.4 The Case of 2l 4 

Theorem 5.15. 2I4 zs noi a transitive algebra. Indeed, for any < r < 1, there is a 
projection F r G M. such that r(F r ) = r and F r G LatWL^. 

Proof. 2l 4 is the algebra generated by Ei 2 ,Fi 2 and M.' . Simple computation shows that 
E\2{E\2 + F12) 2 = {E12 + F\2) 2 Ei2 and Fi2(E\2 + P12) 2 = (P12 + Pi2) 2 Pi2- So 2l 4 C 
{(£'12 + F12) 2 }' . By Corollary 5.11, there is s, < s < \ such that (j,(e 12 +f 12 ) 2 (B (1, s)) = r. 
By Theorem 7.1 of |14| . there is a hyperinvariant subspace F r in .M of (P12 + F12) 2 such 
that r(F r ) = r. □ 

5.5 On the case of 2(2 

Let 2i 2 C B{L 2 (M, r)) be the algebra generated by (M 2 (C), ±Tr) * 1, F i2 and Af . Then 
2I2 ^= 212- By the following proposition, we only need to consider if 2l 2 is transitive and the 
strong closure of 2l 2 is £>(L 2 (Af, r)) or not. 

Proposition 5.16. 2t 2 is transitive if and only z/ 2l 2 is transitive; the strong closure oj ? 2t 2 
is £>(L 2 (A1, r)) if and only if the strong closure of ' 2l 2 is £>(L 2 (A1, r)). 

Proof. Suppose 2l 2 is transitive. Let P G Lat2l 2 . Then P G . With respect to ma- 
trix units of (M 2 (C),|Tr) * 1, M = M 2 (C)®Mi. In the following, we identify M 

with M 2 (C)®Mi. Since PE U = E n P, P = ( ^ ^ Y where Pi,P 2 G <M X . By 
PE12P = E12P and simple computation, we have P 2 < Pi. Write P 12 — \ n n ) 5 where 



v C P , 

A, B,C,D G Ali- By PF 12 P = F 12 P and simple computation, we have (J - P 2 )CPi = 0. 
It can be proved that C is a one-to-one operator with dense range. So tm l (Pi) = 
t Mi (R(CPi)) < t Mi (P 2 ), where r Ml is the trace induced by r on M.\. Since P 2 < Pi, this 
implies that Pi = P 2 . Therefore, P G Lat2l 2 . Since 2t 2 is transitive, P = or J. So 2l 2 is 
transitive. 

Now suppose the strong closure of 2l 2 is £>(L 2 (A1, r)). Then 2l 2 is transitive and there- 
fore 2l 2 is transitive. To prove the strong closure of 2t 2 is £>(L 2 (Af, r)), by Theorem 3.1, 

/ 2 \ 

we need to prove that 2t 2 is 2— fold transitive. Let Q G Lat2l 2 . Then similar arguments 
as above show that Q G LaM^ = LatB(L 2 (M, r)) (2) . By Proposition 1.2, 2t 2 is 2-fold 
transitive. □ 
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